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ABSTRACT 


In  the  comparison  of  military  units  or  systems,  many  attributes, 
including  performance,  might  be  measured.  One  general  approach  to  de- 
termining which  system  is  best  involves  forming  a  composite  measure  of 
the  differentially  weighted  component  measures.  It  is  a  fairly  common 
practice  to  control  the  component  means  and  variances;  it  is  less  com- 
mon, and  more  difficult,  to  control  component  covariances  and,  thus,  to 
control  the  contribution  of  a  component  to  the  variance  of  the  composite 
measure  (variable).  This  paper  presents  a  method  leading  to  a  computer 
procedure  for  assigning  equal  or  differential  influences  on  the  composite 
by  the  use  of  component  means,  standard  deviations,  and  covariances. 
Two  numerical  examples  are  given  herein,  one  illustrating  equal  and  the 
other  unequal  weighting.  The  technique  appears  to  be  both  fast  and  pre- 
cise. 
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I.   INTRODUCTION 

The  section  following  this  shows  that  the  amount  of  variance 
a  component  contributes  to  a  set  of  composite  scores  is  a  function  of 
the  component's  variance  and  its  covariances  with  the  other  components. 
If  a  component's  original  covariances  are  low,  it  may  be  an  indication 
that  this  variable  is  measuring  attributes  different  from  those  being 
measured  by  the  remaining  component  variables,  or  that  it  is  measuring 


the  same  attributes  less  reliably.  By  using  the  procedure  and  assumption 
described  in  this  paper,  a  researcher  can  equalize  the  contributions 
of  all  of  the  components  to  the  variance  of  the  set  of  composite  scores. 
Before  doing  so,  however,  he  should  have  evidence  available  which 
leads  him  to  conclude  that  it  is  necessary  to  increase  the  contribution 
of  a  variable  having  low  covariance  terms.  If,  for  example,  the  com- 
ponent having  low  covariances  consists  of  a  set  of  judgments  made  by 
any  individual  rater,  the  researcher  should  be  convinced  that  this  rater 
was  judging  relevant  attributes  of  behavior  ignored  by  other  raters, 
or  that  he  is  not,  instead,  contributing  non-valid  variance  to  the  com- 
posite scores.  If  the  latter  is  true,  increasing  the  effect  of  these 
data  by  using  the  method  presented  in  this  paper  is,  at  best,  unfor- 
tunate. 


T.     This  report  is  an  extension  of  an  earlier  article  by  R.  S.  Elster 
and  C.  0.  Nystrom,  titled,  "A  computerized  Method  for  Controlling 
Components'  Contributions  to  the  Variance  of  a  Composite",  appearing  in 
Educational  and  Psychological  MzxuuAemtnt,   Vol.  30,  No.  3,  Autumn  1970. 


II.  DERIVATION  AND  COMPUTATIONAL  SOLUTION 

Beginning  with  an  initial  data  matrix,  the  necessary  equa- 
tions can  be  developed.  In  general  terms,  we  usually  have  an  n  x  k 
score  matrix  B,  giving  the  scores  of  n  units  (or  some  other  objects 
of  evaluation)  on  k  variables  (components).  This  matrix  is  then 
standardized  so  that  each  component's  observations  have  a  mean  of  zero 
and  a  variance  of  one;  this  is  designated  as  matrix  Z.  Matrix  Z  is 
also  n  x  k. 

Before  applying  weights  to  any  of  the  k  component  scores 
in  Z,  a  composite  score,  C.  ,  may  be  computed  for  each  of  the  n 
evaluated  objects  by  using: 

k  k 

ci  =  I    ztJ.  e.g.,  c1  =  I    zla<  (1) 

j=l  J=l 


The  variance  of  the  array  of     C.'s     is  given  by: 

Sc  =  Sf  +  SlS2r12  +  '•"  +SlVlk  + 

S2  +  S2Slr21   +   ••••  +  S2Skr2k+  (2) 


Sk  +  Wkl   +  *•••  +SkSk-lrk(k-l)    ■ 
where     r^i.    ,*     designates  the  correlation  between  components     k     and 


(k-1).  For  standard  scores  having  a  mean  of  zero  and  a  variance  of 
one,  the  variance  of  the  array  of  C.'s  is  given  by: 


SZc-   1  +r12+  ....  +  ru  + 


1+r21+ +r2k+  <3> 


+ 


1  +  rkl  +  +  rk(k-l) 

In  equation  (3)  is  a  series  of  terms  for  each  component  consisting  of 
the  component's  variance  along  with  its  correlations  with  all  of  the 
other  components.  As  can  be  seen  from  equation  (3),  the  contribution 
of  the  jth  component  to  the  composite  score  variance  is  given  by: 

k 


Var  (C.)  ■  1  +  I     r.m  (4) 

m=l 


m=l  Jm 


In  order  to  accomplish  the  goal  of  controlling  the  proportion 
of  the  composite's  variance  contributed  by  each  of  the  components, 
one  obviously  must  be  able  to  adjust  the  magnitudes  of  their  variances 
The  adjustment  method  to  be  used  here  is  similar  to  that  used  by 
Dunnette  and  Hoggatt  (1957,  pp.  430-434):  we  shall  multiply  the  set 
of  component  scores  by  a  set  of  weights;  the  weights  will  have  values 
so  that  the  magnitudes  of  their  new  variances  will  equal  the  propor- 
tions of  variance  we  wish  the  separate  components  to  contribute  to 
the  composite. 


Designating  the  weight  for  the  jth  component  by  A.,  the 

J 

new  composite  may  be  computed  by: 


C.  -  ^A.  Z.-.e.g.,^  .  ^  Aj  Z^         (5) 


If  the  components  are  in  standard  score  form,  the  variance  of 
the  C.   's  is  given  by: 

Var  (C  ')  =  I     A  2  +  I       [  A  A  r  m  (6) 

1    j=l  J    j=l  m=l  J  m  J 

and  the  contribution,  b.,  of  the  jth  component  to  the  composite 
score  variance  is  given  by: 

?    k 
b.  =  A/  +  T  A.  A  r.  (7) 

J    J    m^  J  m  jm  v  ' 

An  equation  such  as  (7)  can  be  written  for  each  of  the  j  com- 
ponents. Given  this  set  of  j  equations,  and  given  that  b.  desig- 

J 

nates  the  variance  we  wish  component  j  to  contribute  to  the  composite, 
the  following  system  of  quadratic  equations  must  be  solved. 

?        k 
A-  +  I     A,  Am  r.  =  b.  (8) 

J    m^  J  m  jm    j 

m^j 


The  solution  to  the  above  set  of  equations  will  yield  the  set  of 
weights  (the  A.'s)  to  be  used  as  multipliers  with  the  k  components 
so  that  the  desired  values  of  the  b.'s  are  obtained. 

The  procedure  used  for  solving  the  system  of  simultaneous 
quadratic  equations  shown  in  equation  (8)  is  the  Newton-Raphson 
method  as  shown  by  Scarborough  (1962,  pp.  213-217). 

The  computational  procedure  has  been  programmed  as  a  sub- 
routine. To  use  it,  the  practitioner  need  only  supply:  1)  the 
original  score  matrix,  giving  the  scores  of  n  persons  on  the  j 
components;  2)  the  proportion,  b.  ,  that  each  of  the  j  components 
is  to  contribute  to  the  variance  of  the  composite  (each  b.  must  be 

J 

expressed  as  a  positive  decimal,  and  the  sum  of  the  b  's  must  be  equal 
to  one);  and  3)  an  e  value  that  terminates  the  iterative  compu- 
tational procedure.  The  parameter  e  will  be  discussed  later  in  this 
report. 

III.  MATHEMATICS  OF  THE  COMPUTATIONAL  PROCEDURE 

In  the  case  of  two  components,  there  would  be  two  equations 

in  two  unknowns.  Let  <J>(X,Y)  =  0,  and  ^(X,Y)  =  0  represent  the  two 

equations.  If  X  ,  Y   are  approximate  roots  of  <J>  and  ty     ,  and 
h  and  I    are  corrections,  then  let 


X  =  X  +  h 
o 


Y  =  Y     +  I 
o 


Scarborough  (1962,  pp.   214)  shows  that 


or 


4>(X0,Y0)  +  h(6<j>/6x)0  +  *(ty/6y)0 


0 
MX0,YQ)  +  h(6*/6*)0  +  £(5ip/6y)0  =  0 


(«*/6x)0   (6<|>/6y)o 


(6^/6x)o   (<5ip/6y)o 


I 


-  *<W 


-  *(X0,Y0) 


(9) 


The  goal  is  to  solve  for  h  and  I    letting  X1  =  XQ+  h,  Y,  =  Y  +  I, 
etc.;  iterating  until  a  desired  level  of  accuracy  is  achieved. 

In  the  general  case  of  weighting  components  which  are  in  standard 
score  form  (using  the  notation  from  equation  (8)): 


<j>.  =  A 


k 

I    A. 


r . 


I  mi1     m    jm 


b.  ;  j 


I)        L.   J         .    •    .     ,        Y\ 


(10) 


Then,  letting     <|>.  =  <j>./A.    , 

* 


and  differentiating,     6<j>./6A    =  r.       , 


when    j  f  m    and     6(f). /6A    =  b./A^  +  1,  when    j  =  m. 

■J  III  \J  J 

So  for  the  general  case,  Equation  (9)  becomes 


(t) 


1  + 


m 


21 


kl 


12 


(t) 


1  + 


k2 


13 


(p)2     "23 


•      • 


Ik 


2k 


(t) 


1  + 


m 


,(t) 


A 


m 


j=i  J    Jl 

j  =  l    J      ^ 


7m 


jk 


(11) 


The  iterations  are  performed  by  letting  A.   '  =  A.   +  h., 
j  =  1,  2,  ...,  k,  and  recalculating  both  the  right-hand  array  and 
the  diagonal  of  the  coefficient  array.  For  an  exact  solution,  the 
right-hand  side  of  Equation  (11)  will  go  term  by  term  to  zero.  The 
convergence  procedure  used  by  the  author  of  this  paper  tested  to 
determine  if  the  terms  on  the  right  side  of  Equation  (11)  had  all 
become  equal  to,  or  less  than,  an  epsilon  (e).  The  user  must  specify 
an  e  value  which  is  used  in  terminating  the  iterations  when  all  of 
the  terms  on  the  right-hand  side  of  Equation  (11)  are  <e  .  Initially, 


a(°)  =  1.0  for  all  j 
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IV.   EXAMPLES 

Artificial  raw  scores  were  generated  yielding  the  standard 
score  covariance  matrix  given  in  Table  1.  (This  matrix  is  an  optional 
output  available  from  the  computer  program  allowing  the  user  to 
examine  the  original  component  weights.) 

By  examining  the  row  of  figures  in  Table  1  giving  the  percent 
contribution  of  each  rater  (component)  to  the  variance  of  the  composite 
scores,  it  is  evident  that  the  original  components  are  unequally 
weighted.  Using  the  data  given  in  the  table,  two  solutions  are 
demonstrated  in  the  following  paragraphs.  The  first  example  illus- 
trates the  case  in  which  the  user  wishes  to  assign  equal  weights  to 
all  of  the  components.  In  the  second  example,  the  user  assigns 
unequal  proportions  to  the  components. 

Table  1    STANDARD  SCORE  COVARIANCE  MATRIX 


Raters 
(Components) 

A 

Raters 
B 

(Components) 
C       D 

E 

F 

A     1 

.00 

-.225 

.233 

-.084 

.118 

-.509 

B 

.225 

1.00 

-.009 

.521 

.099 

-.151 

C 

.233 

-.009 

1.00 

.112 

.256 

-.306 

D 

.084 

.521 

.112 

1.00 

.196 

-.264 

E 

.118 

.099 

.256 

.196 

1.00 

-.236 

F 

.509 

-.151 

-.306 

-.264 

-.236 

1.00 

Rater's  Contribution 

to  the  composite  score 

variance     .533    1.235    1.286    1.481    1.433    -.466 

Total  score  variance  =  5.502 


A.  Equal  Weighting 

The  data  summarized  in  Table  1  were  initially  run  through 
the  computational  subroutine  with  the  specification  that  each  of  the 
six  components  should  make  an  identical  contribution  to  the  variance 
of  the  composite.  The  weights  to  be  applied  to  the  components' 
standard  scores  in  order  to  equate  the  contributions  of  the  six 
components  are  given  in  Table  2.  The  weights  in  Table  2  were  derived 
by  applying  the  computational  method  outlined  above  to  the  system 
of  six  equations  similar  to  that  given  in  Equation  (8);  the  weights 
in  Table  2  are  the  roots  of  the  six  equations  for  this  example. 

Table  2    WEIGHTS  TO  BE  USED  AS  MULTIPLIERS  WITH 
THE  COMPONENTS'  STANDARD  SCORES  FOR  THE  EQUAL  CONTRIBUTION  EXAMPLE 

Raters  (Components)  A      B      C      D      E      F 
Weights  1.638   1.031    .937     .904     .858    2.144 

Table  3  shows  the  covariance  matrix  that  resulted  after 
applying  these  weights  to  the  components'  standard  scores.  Table  3 
(using  the  notation  of  Equation  8)  contains  the  elements  A. 2  r. • 

J     J  J 

on  the  main  diagonal  and  the  elements  A.  A  r.   off  the  diagonal. 

The  column  in  Table  3  that  lists  the  percentage  of  the 
composite's  variance  contributed  by  each  of  the  components  shows  that 
the  contributions  of  the  six  components  were  equated  by  the  computa- 
tional method.  The  solution  of  the  equations  required  4  iterations; 
about  3.2  seconds  of  computer  time  was  required  for  the  entire  run. 
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(The  iterations  were  terminated  when  each  of  the  six  roots  had  an 

accuracy  of  <_.  00001 .) 

B.  Unequal  Weighting 

To  illustrate  that  the  computatonal  procedure  can  also  be 

used  in  solving  for  differential  weights,  Tables  4  and  5  show  the 

results  obtained  when  the  six  components  were  specified  as  contributing 

.50,  .10,  .10,  .10,  and  .10  of  the  composite's  variance.  This  run 

required  4  iterations  to  achieve  £.00001  accuracy  for  each  of  the 

six  roots. 

Table  3    C0VARIANCE  MATRIX  DERIVED  AFTER  APPLYING  THE  COMPUTED 
WEIGHTS  FOR  THE  EQUAL  CONTRIBUTION  EXAMPLE 


Raters 
(Components) 

A 

Raters 
B 

(Compo 
C 

nents) 
D 

E 

F 

Per 
Cent3 

A 

2.683 

-.380 

.357 

-.125 

.166 

-1.788 

16.67 

B 

-.380 

1.063 

-.008 

.485 

.087 

-.334 

16.67 

C 

.357 

-.008 

.878 

.095 

.206 

-.615 

16.67 

D 

-.125 

.485 

.095 

.817 

.152 

-.512 

16.65 

E 

.166 

.087 

.206 

.152 

.736 

-.433 

16.68 

F 
Rater's  Cont 

-1.788 
ributio 

-.334 
n 

-.615 

-.512 

-.433 

4.595 

16.67 
100. 01b 

to  the  composite  score 

variance     .913   .913    .913    .912    .914    .913 

Total  score  variance  =  5.478 


aPercent  the  component  contributed  to  the  composite's  variance 
This  column  does  not  total  to  100.00  due  to  rounding  errors. 
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Table  4    WEIGHTS  TO  BE  USED  AS  MULTIPLIERS  WITH  THE  COMPONENTS' 
STANDARD  SCORES  FOR  THE  UNEQUAL  CONTRIBUTION  EXAMPLE 

Raters  (Components    A      B      C      D      E        F 
Weights  2.324    .960    .680    .772    .654     2.151 


Table  5    COVARIANCE  MATRIX  DERIVED  AFTER  APPLYING  THE  COMPUTED 
WEIGHTS  FOR  THE  UNEQUAL  CONTRIBUTION  EXAMPLE 


Raters 
(Components) 

A 

B 

Raters 
C 

(Components) 
D      E 

F 

Per 
Cent3 

A 

5.402 

-.503 

.368   - 

-.151 

.180 

-2.546 

49.99 

B 

-.503 

.922 

-.005 

.386 

.062 

-.312 

9.98 

C 

.368 

-.006 

.463 

.059 

.114 

-.448 

10.00 

D 

-.151 

.386 

.059 

.596 

.099 

-.438 

10.02 

E 

.180 

.062 

.113 

.099 

.427 

-.331 

10.02 

F 

-2.546 

-.312 

-.448 

-.438 

-.331 

4.625 

10.00 

Rater's  Contribution 

100. 01b 

to  the  composite  score 

variance    2.750    .549    .550    .551    .551    .550 

Total  score  variance  =  5.501 


Per  cent  the  component  contributed  to  the  composite's  variance 
This  column  does  not  total  to  100.00  due  to  rounding  errors. 


12 


V.  SUMMARY 

A  computer  procedure  was  developed  for  weighting  components  in 
a  composite.  The  procedure  allows  the  user  to  freely  choose  how  much 
of  the  variance  of  a  set  of  composite  scores  is  contributed  by  each 
of  a  number  of  components. 

Two  numerical  examples  using  artificial  input  data  were 
demonstrated  illustrating  an  equal  weighting  solution  and  an  unequal 
weighting  solution.  In  both  sample  problems,  the  solutions  reached  the 
desired  level  of  accuracy  in  about  three  seconds. 
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